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Caveat 


The  Technology  Maturity  Measurement 
System  described  in  this  brief  is  a  proposal  to 
DND  sponsored  by  Maritime  Technology 
Insertion  Working  Group.  As  such  it  does  not 
represent  approved  government  policy  or 
processes. 
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Background 


•  The  current  Canadian  Forces  (CF)  system/equipment 
acquisition  process  is  known  as  the  Defence  Management 
System  (DMS)  and  it  involves  a  series  of  linear  steps  where 
information  related  to  systems/  equipments  being 
developed  or  considered  for  purchase  is  systematically 
passed  for  action  between  the  operational,  engineering  and 
procurement  groups. 


The  system  has  five  phases  with  go/no-go  decision  points 
as  shown: 

-  Identification  (end  of  phase  review  and  decision  to 
proceed) 

-  Options  Analysis  (selection  of  best  options  and  decision 
to  continue) 


Definition  (decision  to  purchase  and  to  implement) 
Procurement 


Close-out 
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CF  Defence  Management  System 
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should  be  pursued 
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costing  of  selected 
option. 

Implementation 

planning 
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Monitoring,  i.e. 
Initial/Full  Operational 
Capability  Milestones 

Procurement/ 
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implementation 


Definition  Planning 


CLOSE-OUT 


Full  Operational 
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Operational 
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Decision 
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Decision 

SS(PPA) 


Decision 
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Background 


•  Currently  there  is  no  common  system  that  allows  all  of 
these  organizations  to  have  the  same  clear  understanding 
of  the  technical  maturity  level  of  any  system/equipment 
at  any  point  in  the  process. 


This  makes  assessment  of  technological  maturity  (or 
inversely  the  risk  to  productize  such 
systems/equipments)  very  difficult  and  related  project 
team  discussions  and  decisions  become  equally  difficult. 
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Maturity  Measurement  Concepts 


There  has  been  a  wide  body  of  work  completed  in  this  area  and  a 
number  of  different  systems  have  been  developed  to  measure  the 
technological  maturity  of  military  equipment/systems  such  as: 

-  Technical  Readiness  Levels  -  ratings  based  on  demonstrated 
system  performance  ie:  laboratory  proven,  field  proven; 

-  Interface  Maturity  Levels  -  rates  an  equipment/system  on  the 
degree  to  which  it  is  able  to  interact  with  the  other  equipment/ 
systems  in  the  field; 

-  System  Readiness  Levels  -  measures  the  degree  documentation, 
training,  life  cycle  support  requirements  have  been  completed; 

-  Design  Maturity  Levels  -  establishes  a  series  of  design  review 
targets  over  the  life  of  a  project;  and 

-  Manufacturing  Readiness  Levels  -  measures  issues  of  concern 
for  getting  the  equipment/sy stem  into  commercial  production. 
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Maturity  Measurement  Concepts 


•  Of  these  systems,  the  TRL  system  has  found  the  greatest  degree  of 
acceptance  and  implementation  in  other  navies.  DRDC  is  in  the 
process  of  implementing  this  system  for  use  with  their  Technical 
Demonstration  Program 

•  However,  as  noted  by  Mr.  William  Nolte  (US  Airforce  Research 
Laboratory,  Wright  Patterson  Air  Force  Base), 


“The  TRL  scale  measures  maturity  along  a  single  axis,  the 
axis  of  technology  capability  demonstration.  A  full  measure 
of  technology  maturity,  or  in  the  commercial  world  product 
maturity,  would  be  a  multi-dimensional  metric.  It’s  not 
uncommon  to  find  references  to  1 2  or  more  dimensions  of 
product  or  technology  maturity.  One  writer  speaks  of  1 6 
different  dimensions  of  maturity.  The  TRL  measures  only 
one  of  the  16”  1 


1  Nolte,  William  L.  Supportability  &  Systems  Engineer, 
TRL  Calculator,  MRL  Background 


AFRL  Sensors  Directorate,  Wright  Patterson  AFB, 
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Technical  Maturity  Level  System 


•  In  an  attempt  to  broaden  the  scope  of  technical 
maturity  measurement  for  the  CF,  the  Technical 
Maturity  Level  (TML)  system  has  been  developed  at 
DRDC  Atlantic  as  part  of  the  Maritime  Technology 
Insertion  Working  Group  study. 


This  proposed  system  utilizes  the  NATO  TRL  system 
as  a  baseline,  but  it  expands  each  TRL  level  to 
incorporate  the  measurement  criteria  for  the  other 
systems  at  the  equivalency  levels  shown  in  the 

following  Table. 
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Table  1  -  Cross  System 
Equivalency  Levels 


Tech 

Maturity 

Level 

(TML) 

Tech 

Readiness 

Levels 

(TRL) 

Interface  Maturity 
Levels 
(IML) 

Design 

Maturity 

Levels 

(DML) 

System  Readiness 
Levels 
(SRL) 

Manufacturing 
Readiness  Levels 
(MRL) 

0 

0 

1 

1 

1 

2 

1 

2 

2 

3,4 

2 

3 

3 

5 

3 

1 

3 

4 

4 

6 

4 

2,3 

4 

5 

5 

7 

5 

4,5 

5 

6 

6 

8 

6 

6 

6 

7 

7 

9 

7 

7 

7 

8 

8 

8 

8 

8 

9 

9 

9 

9 

9 

TML 

T-TRL 

P-PROGRAMMATICS 

M  -  MANUFACTURING 

f\j Technical  Maturity  Level  System 


•  In  developing  the  TML  scale,  it  was  decided  that  each  each  level 
would  be  comprised  of  criteria  from  three  sub-areas: 


-  Technical  Readiness. 

-  Programmatics  -  this  sub-area  combines  the  measurement 
criteria  for  Interface,  Design,  and  System  issues 

-  Manufacturing  Readiness. 


The  criteria  in  each  of  the  sub-areas  must  be  met  before  making  a 
TM  Level  determination  for  any  system/equipment 

An  extract  of  the  resulting  Technology  Maturity  Level  (TML) 
scale  is  shown  in  Table  2  and  the  following  slide  shows  the  use  of 
the  TML  system  in  the  CF  Defence  Management  process. 
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Table  2  -  TML  Scale  Extract 


TM 

Level 

Description 

T-Technical  Readiness,  P  -  Programmatics,  M  -  Manufacturing  Readiness 

4 

T  -  Component  &  /  or  “Breadboard”  Validation  in  Laboratory/Field  Environment  -  Basic 
technology  components  are  integrated.  This  is  relatively  “low  fidelity”  compared  to  the  eventual 
system.  Examples  of  R&D  results  include  integration  and  testing  of  “ad  hoc”  hardware  in  a 
laboratory/field  setting.  Often  the  last  stage  for  R&D  (funded)  activity. 

P  -  Interfaces  partially  demonstrated  -  system/sub-system  level  in  a  high  fidelity  synthetic 
environment 

-  Critical  design  review  completed  for  critical  sub-systems 

-  Preliminary  Safety/Environmental  assessments  complete 

-  Supportability  work  breakdown  structure  completed 

-  Sub-system  R&M  case  developed  for  sub-systems. 

-  Initial  Human  Machine  Interface  design  completed 

-  Key  Sub-System  schematics  completed. 

-  All  Sub-System  Specifications  defined 

-  Engineering  and  operational  communities  negotiated  a  formal  commitment  to  use  the  results 
of  the  research. 

M  -  Laboratory  Manufacturing  Process  demonstrated 
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Conclusions 


•  The  CF  currently  has  no  system  to  measure  and  report 
technology  maturity  levels  between  the  various  NDHQ 
groups  who  collectively  progress  the  development, 
procurement  and  acquisition  of  systems  and  equipment. 


Canada’s  major  defence  allies  (US,  UK)  are  developing 
and  implementing  a  number  of  different  systems  to 
provide  this  common  traceability  for  their  acquisitions. 

A  combined  system  such  as  the  TML  would  be  a  good 
starting  point  for  the  CF  to  add  such  a  capability  into  the 
development  and  acquisition  aspects  of  systems  being 
progressed  through  the  DMS. 
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